STRONG LAWS FOR BALANCED TRIANGULAR URNS 
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Abstract. Consider an urn model whose replacement matrix is triangular, has all entries nonnegative and 
the row sums are all equal to one. We obtain the strong laws for the counts of balls corresponding to each 
color. The scalings for these laws depend on the diagonal elements of a rearranged replacement matrix. We 
use the strong laws obtained to study further behavior of certain three color urn models. 



1. Introduction 

Consider an urn with balls of [K + 1) colors. Initially the counts of balls of each color are non-random, 
strictly positive real numbers and the total count of balls in the urn equals one. Let the row vector Co 
denote the initial count of balls of each color. The composition of the urn evolves by adding balls of different 
colors at times n = 1, 2, 3, ... as follows. 

Suppose R = ((rij)) is a (K + 1) x (K + 1) non-random balanced (that is, each row sum is same and 
hence, without loss of generality, one) replacement matrix with nonnegative entries. Let C n denote the row 

vector of the counts of balls of each color after the n-th trial, n = 1, 2, At the n-th trial, a ball is drawn 

at random from the urn with the current composition C„_i, so that the i-th color appears with probability 
C n -n/n, i = 1, . . . , (K + 1). If the i-th color appears, then, for j = 1, . . . , (K + 1), balls of j-th color are 
added to the urn before the next draw, together with the drawn ball. It is of interest to study the stochastic 
behavior of C„ as n — > oo. 

In case R is irreducible , let itr be the unique stationary distribution satisfying tvrR = tvr. Then (see, 
for example. iGouetl . Il997j ) C n /(n +1) — > ttr almost surely. Note that ttr is also a left eigenvector of R 
corresponding to the eigenvalue 1. However, when R is not irreducible or balanced, the balls of different 
co lors may incre ase at different rates and strong or weak limits for C n are not known in full generality. 



Janson (|2006h considered two color triangular urn models, where the replacement matrix was not neces- 
sarily balanced, and identified the weak limits of C n in all possible cases. He mentioned urns with more 



colors and triangular repla cement matrices as possible objects of further study (cf. I Janson . 2006, Problem 
1.16). iFlajolet et al.l (|2006l ) considered a three color urn having balanced triangular replacement matrix R 
with further conditions on the entries and obtained weak limit theorems. 

Motivated by these results, we consider balanced, triangular urns with arbitrary (but finite) number of 
colors. T his assumption of balancedness on R allows us convenient a pplication of m a rtinga le techniques. In 



contrast, 



Jansonl ( 20061 ) used the theory of branching processes and iFlaiolet et all ( 20061 ) used generating 



functions . However, the app l ication of mar tingale techniques to the study of urn models is not new, see for 
example, Bai and Hul (1993), 



Gouetl (119971 ) 



With appropriate scalings, we establish almost sure convergence of each color count to non zero limits. 
Under an additional assumption, see (|2.2p , the limits are expressed in terms of the limits of certain martingales 
and left eigenvectors of appropriate submatrices of !?. These strong laws for urn models with arbitrary but 
finite number of colors and balanced triangular replacement matrices are the main contributions of this 
article. 

The outline of the rest of the paper is as follows. Section [2] first describes a rearrangement of colors 
which converts any triangular balanced replacement matrix to an appropriate standard form. Our results 
are better described with reference to this standard form. Of course the convergence holds without assuming 



2000 Mathematics Subject Classification. Primary 60G70, 60F05; Secondary 60F10. 
Key words and phrases. Urn model, balanced triangular replacement matrix. 



1 



2 



A. BOSE, A. DASGUPTA, AND K. MAULIK 



the standard form but the results are cumbersome to state, see Remark 13.41 We also state the additional 
assumption (|2 . 2[) required to identify the limits in somewhat explicit forms. This section also establishes the 
notation to describe the limits and states some auxiliary results we need. 

In Section [3l we state and prove the main theorem. In case of a color whose corresponding diagonal entry 
is larger than all the preceding ones, we consider the right eigenvector of R corresponding to this eigenvalue 
and normalize the corresponding linear combination to obtain a martingale. This martingale turns out to be 
.L 2 -bounded and hence converges almost surely. The convergence of the individual color count then follows, 
since earlier colors have lower rates. For colors whose corresponding diagonal entry is not larger than the 
previous ones, we first show that the appropriately scaled color count is Z^-bounded. Then we form the 
appropriate martingale and obtain the convergence. In Section 01 we analyze the three color urn model with 
triangular replacement matrix as a corollary and obtain the asymptotic behaviors of linear combinations of 
color counts. This gives an indication of further results that can be proved using the strong laws of this 
article. 



2. Notation and Preliminary Results 

Suppose R is a balanced triangular replacement matrix with row sums one. Denote the diagonal elements 
of R as rfc, 1 < k < K + 1. Let 1 = i\ < «2 < • • • < ij < i(j+i)(= K + 1) denote the indices of the running 



< r,-„ < 



<r ir < r, 



(j+i) 



= tk+i and for ij < k < 



we 



maxima of the diagonals, namely, r\ = 
have r k < for j = 1, 2, . . . , J. 

Remark 2.1. Since the row sums arc 1 and the elements of R are nonncgativc, all the diagonal elements will 
be less than or equal to 1. Thus, (K + 1) will always be an index of the running maximum of the diagonals. 

The running maxima of R also lead to the following concepts: 

Definition 2.2. Suppose R is a balanced triangular replacement matrix. For j = 1,2,..., J, the colors 



indexed by ij 



1, . . . ,i(j+i) — 1 constitute the j-th block of colors, ij is called its leading index, and the 

1) will be the 



corresponding color is called the leading color of the j-th block. The color indexed by (K 
leading color and the sole constituent of the (J + l)-st block. 

The triangular replacement matrix R with the indices of the running maxima of the diagonals can be 
visualized as 



/ 



R 



ri2 
r-2 



n 2 -i ■ ■ ■ 

r,:„ 



Tk,ifj +1) -l 



'*«+!)- 



fk,i(j +1 ) 



\ 



\ 



1) / 



Here r\ = r^ < r.i 2 < ■ ■ ■ < < fi u+1) =< ■ • • < §^ ve ^ ne running maxima of the diagonal entries. It 

will be helpful to study the concepts of rearrangement and blocks, while keeping this visualization in mind. 

To study urn models with triangular replacement matrices, we need to arrange the colors systematically, 
which we describe next. This particular rearrangement keeps the replacement matrix triangular. The new 
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replacement matrix is obtained by pre- and post-multiplication of R by permutation matrices. Thus, it 
remains balanced with row sum 1 and has the same set of eigenvalues. The elements of the new eigenvectors 
are also suitable rearrangements of the original ones. 

Definition 2.3. The colors are said to be arranged in the increasing order if R satisfies the following: with 
1 = i\ < «2 < ■ ■ • < i J < i(j+i)(= K + 1) as the indices of the running maxima of the diagonals, for 
ij < k < i(j+i) , j = 1, 2, . . . , J, we have 

fc-i 

r mk > 0. (2.1) 

m—ij 

It is easy to see that, (12.1[) is equivalent to the fact that, for any non-leading color with index k in j-th 
block, namely, for ij < k < i(j+\) , with j = 1, 2, . . . , J, the part of /c-th column in the j-th block has at least 
one non-zero entry. Also note that Condition (|2.1jl holds only for non-leading colors. 

The next proposition shows that any urn model with triangular replacement matrix can be transformed 
into another urn model with triangular replacement matrix such that the colors are in increasing order. 

Proposition 2.4. Suppose R is a balanced triangular replacement matrix with row sums one. Then there 
exists a rearrangement of the colors in the increasing order, such that the replacement matrix remains tri- 
angular. 

Proof. From Remark 1 2. 1[ we have that the (K + l)-st color forms the last block as required. We shall now 
construct the other blocks inductively going backward. Within a block, the construction will move forward. 

Suppose we have constructed some blocks. If the leading index of the last constructed block, say i, is 1, 
we are done. 

If i > 1, we construct the next (previous) block as follows. Let k < i be such that rj, = max{r m : m < i}. 
The color with index k is declared to be the leading color of the present block under construction and the 
index of this color may change, as discussed later, through rearrangement. 

By our choice of leading colors, the diagonal entries of the indices of the leading colors will be in nondc- 
creasing order, as required. 

Next we decide which of the intermediate colors with index m, k < m < i will be in the present block. 
This will be done through a process of rearrangement described inductively going forward. 

Suppose I colors, including the leading color, satisfying (|2.ip . have been obtained through rearrangement 
for the present block and the index of the leading color has changed to k'(> k) after this rearrangement. 
Then the index of the last considered color was k 1 + 1 — 1. If k' + I = i, we have considered all intermediate 
colors and the construction of the block is over. 

If k' + I < i, consider the color with index k' + I. By choice of the leading color of the present block, we 
must have r^ > rk>+i- If we have Yl m =k' * r m,(k'+l) > 0, we take the color with index k' + I as the (I + l)-st 
color of the present block. 

Otherwise, T m ,(fc'+?) = for m = k', k' + 1, . . . , k' + I — 1. In that case, we reshuffle the colors to bring 
(fc' + Z)-th color ahead of the fc'-th one, and then r m ^'+i), m = k', k' + 1, . . . , k' + 1 — 1 will be the only entries 
which will move below the diagonal of the fc'-th column in the reshuffled replacement matrix. Hence the 
reshuffled replacement matrix will remain triangular. After reshuffle, this color will have index fc' and the 
index of the colors already in the present block will increase by 1, with the present leading index increasing 
to fc' + 1. The number of colors in the present block will remain at I. This gives the forward induction step 
for constructing a block. Since a color is shuffled up if it fails (|2.1[) . all the remaining colors will satisfy this 
condition. Thus we complete the backward induction step for rearrangement of blocks. □ 

In view of the above proposition, we shall always assume, unless otherwise mentioned, that the colors are 
indeed in increasing order. 

Note that if = ri j+1 and r m ^ u+1) = for all m = ij, ij + 1, . . . ,i^j + i^ — 1, then we can reshuffle the 
colors to bring the iQ+^-th color ahead of the ij-th one, yet maintaining the triangular structure of the 
replacement matrix and the increasing order of the colors. Hence the rearrangement of the colors in the 
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increasing order will not be unique. To make the above rearrangement of the colors to the increasing order 
a unique one, we further assume that 

rm -H J+ D > °> whenever r h = r i( . +1) . (2.2) 

m—ij 

Assumption (|2.2|) is equivalent to requiring at least one non-zero entry in the i(j +1 )-th column in the part 
corresponding to the j-th block. Its significance has been discussed later in Remark 13.21 

We define the following submatrices and vectors corresponding to different blocks of colors. 

Definition 2.5. Let R^' be the submatrix formed by the rows and columns corresponding to the indices 
of the j-th block. We shall also write Xj = r is = r\ ' . The part of the vector C„ corresponding to the j-th 

block will be denoted by Finally, will denote the part of ij + i-th column corresponding to the j-th 

block. 

By the definition of a block, n, = Xj is the strictly largest eigenvalue of R,W) and has multiplicity 1. Let 
7r^ be the unique left eigenvector of R^ corresponding to the eigenvalue Xj normalized so that its first 
element is 1. Then irv) satisfies 

n U)R0) = Xjir^, tv[ j) = 1. 

Observe that if ij <m,k< then C nm = C^{ m _ ij+1) and r mk = rjj£_ <j+1)i(fc _< j+1) . 

Next we define an index to count the number of times the diagonal entry corresponding to a leading color 
has occurred before. This is important in obtaining the rate of color count in Theorem 13. 11 

Definition 2.6. For the j-th block with leading color index ij, let 

Observe that, if r m = Xj, for some m < ij, then m is a leading index as well. So, if it is the first time 
a diagonal has value Xj, we have Vj =0. Also note that Xj-\ = Xj if and only if t/j > 0, and in that case 
Vj-i = Vj — 1 holds. 

The following useful result is obtained as a consequence of the above definitions. 

Lemma 2.7. If the colors are in increasing order and the replacement matrix R is triangular, then the 
vector ir^ has all coordinates positive. 

Proof. We prove this by induction on the coordinates of the vector. 

Observe that if fj. = 0, then the j-th block has only one color, namely, the ij-th one. By the choice of 

(7) 

normalization, tv\ = 1. If = 0, then by the above observation, the proof is complete. So, without loss 
of generality, we can take fj. > 0. 

Now assume that the first k(< — ij) coordinates of tt^' are positive. By the property of the 

eigenvector of we have £mt!i r (m+l] _ 1):(k+t]) = r^-rr^, which gives 

1 k 
U) 1 \ " a) 

Now the denominator on the right side is positive, since r ij is the strictly largest eigenvalue. By induction 

hypothesis, Ttn) > 0, for m = 1, . . . , k. Also, by (|2.1|) . Tf m -Hj—i),(k+it) > for some m = l,...,k. This 
proves the induction step and the lemma. □ 

We also denote II„(s) = n"^ 1 + Wi)' -R- ecau that Eulcr's formula for gamma function gives 

II n (s) ~ n s /r(s + 1), if s is not a negative integer. (2.3) 
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3. Main Results 

Now we state and prove our main result on the strong convergence of individual color counts. 

Theorem 3.1. Suppose R is a (K + 1) x (K + 1) balanced and triangular with row sums one and (J + 1) 
blocks and the colors are in increasing order satisfying (|2.2|) . Then, for j = 1, 2, . . . , J + 1, 

C$ /{N Xi (logN) v *} —> TT^Vj almost surely, as well as in I?, 

where Vj+i = 1. If r± = 0, then V\ = Cqi- If r± > 0, then V\ is a non- degenerate random variable. For 
j = 2, 3, . . . , J, if Vj = 0, then Vj is also some non- degenerate random variable. If Vj > 0, we further have 

Vj = — irU-V pU-VVj-L (3.1) 

Remark 3.2. Note that, due to Lemma \2. 71 n^ -1 ' has all entries positive, and *) has at least one entry 
positive by (|2.2|) . which makes 7r" _1 )p" _1 ) > and hence, recursively, all the Vj's are nondegenerate. 



Remark 3.3. If rj = 1 for some j < K, then the rest of the entries in the j-th row are zero. Thus, (|2.1[) 
requires rj+% = 1 and the (j + l)-st color will be the leading color of a new block. However, if l|2.2|) is also 
assumed, even this is not possible. So, in the setup of Theorem l3. II above, we must have Tj < 1 for all j < K. 

Remark 3.4. The rearrangement of the colors to the increasing order and Condition (|2.2p help us identify 
the limits in Theorem 13.11 However, it will be clear from the proof that even without this assumption, 
appropriate strong laws hold. In this approach, we do not use the concept of blocks. It can be shown that 

— — - Cni — * Wi, almost surely 

jy ri 111 17 J 

for some random variable W\. We can then define inductively, the rates for all colors j > 1 as follows: 
assume that for all 1 < j < k, there exists Sj and Sj and random variables Wj such that 

— — ^ r-rj Cni — > Wj almost surely. 
N*J (log N) s i ] 3 

If the part of the (k + l)-st column above the diagonal has all entries 0, then for some random variable Wk+i , 

jvLd Cjv '( fc+i ) ~* Wk+i - 

On the other hand, suppose rjik+\\ > for some j = 1,2,..., k. Consider all the colors indexed by j 
such that rj Jk+i) > 0. Let the highest rate of convergence for such color counts be n s (logn) 5 . Then one can 
say that 

— CV(fc+i) Wu+i almost surely, 
a„ 

for some random variable Wk+i where 

n s (logn) s , if r fc+ i < s, 
n s (logn) s+1 , if r k+1 = s, 
n Tk + 1 , if r k+1 > s. 

It is not clear if one can easily write down how the W^s are related. However, under Condition (|2.2p . if we 
rearrange the colors in the increasing order, the subvectors corresponding to each block obtained from the 
rearranged WVs are of course the same as tt^Vj's and will satisfy 



Proof of Theorem \3.1\ The proof is through induction on the index of color I. Let \ n be the row vector of 
order (K + 1) with the m-th entry 1 if the m-th color is drawn at the n-th draw, the other entries being 
zero. Let T n denote the er-field generated by {Xk ■ 1 < k < n}. 

So we first quickly verify the result for 1 = 1. If r\ = 0, then the entire first column is zero, so the first 
color count cannot change whichever color be drawn. Thus C n \ stays constant at Coi and the result is 
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trivially true. Next consider n > 0. In that case, we pool all the remaining colors and that gives us the 
replacement matrix 

S l - n 
1 



Then the result for Z = 1 follows from Proposition 2.2 (iii) of iBose et alj (|2008l ). 

Now assume that the result holds for the first (Z — 1) colors for some I > 2. Suppose the next color is the 



A:-th color of the j-th block. Then we have I 



i, + 



1. 



The following two observations follow from the induction hypothesis: 



(i) If I is a leading color, that is, k = 1 and I 

C Nm 



'J- 



we have 



A^j-i(logiV)^- 1 



V , 

7r m+l-iy_i ) \7-li 

o, 



if 



< m < ij 



if m < i(j-i) 



(3.2) 



almost surely, as well as, in L 2 . 

(ii) If I is not a leading color, that is, k > 1 and I > ij, we have 



C 



N, 



N x > (log 7V) 1 - 



r Ci) 



0, 



if ij < m < I, 
if m < i,- 



almost surely, as well as, in L 2 . In particular, we have, for m < I, 



E\C 



Nr. 



OiN^QogN)"*- 1 ), 
0{N X ' (logJV)^), 



if fc = 1, 
if k > 1. 



(3.3) 



(3.4) 



We separate the proof into three cases: Case 1: k = 1, Vj = 0; Case 2: fc = 1, Vj > and Case 3: k > 1. 



Case 1: k = 1 and ia 



0. Let ( be a right eigenvector of i? for the eigenvalue Ab- 



normalized 



so that its C 2 : = !• Observe that 
C fe > 0, for fc < ij. 

Consider the martingale Um — C NC/^-N(^j 

Un+i — Un 



i I for k > ij, and since 



gives rfc < r^. for all k < ij, we have 



Then the martingale difference is 



n 



JV+l 



'AT 



iV+ 1 



Denote £ to be the column vector whose coordinates are squares of those of £■ Hence, we have 



E[{U N+1 ~U N f\T N ] 



Aj 



(n 



< 



fi(A,)) 2 
1 



N + 1 

c N c 2 



c N c 

N + 1 



< 



ICIIc 



(n w+1 (A,)) 2 /v + i - (jv + 1)^+1(^0 



U N < HCHoo^Aj- + 1) 



1 



(N + 1)!+^ 



for all large enough N, where ||C||oo is the largest coordinate of C (recall that all the coordinates of £ are 
non-negative) and the last inequality follow s using the f act 2U n < 1 + and (|2.3[) . 

As in the proof of Proposition 2.2 (iii) of IBose et al.l (|2008h . this gives an iteration for 1 + -E[L^] and we 
can prove Un is i 2 -bounded and hence converges almost surely, as well as, in L 2 . Thus, by (|2.3p . Cn£/N ' 
also converges almost surely, as well as, in L 2 , to Vj, say. 

Note that U\ = Ci£/(1 + Xj) = (CoC + AjXiC)/(l + Aj). Since Cq has all coordinates positive, Xi 
takes all coordinate vectors as values with positive probability. Thus, XiC 1S constant if and only if £ has 
all coordinates of same value. This will be the case if and only if the corresponding eigenvalue is 1, which, 
by Remark 13.31 holds if and only if I = K + 1 and j = J + 1. So in that case, CnC = N + 1 an d we have 
U N = C N C/(N + 1) = 1 = V J+1 . 

If j < J, U\ is nondegenerate and hence has positive variance. Since Un is a martingale, variance of Un 
is nondecreasing and the limit variable has nonzero variance. So the limit variable Vj is nondegenerate for 
J < J- 
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Finally using the limit of C NC/N Xj , since £ k = for k > ij and £ 4 . = 1. we have 

1 1 
lim — r— C7vi = Vi — C m li m TTrCjVm almost surely and in L 2 , 



m— 1 



provided the limits on the right side exist. Now, since Uj = 0, we have Aj_i < Aj, and by 
on the right side are all zero. Thus, 

1 lj\ 2 

-C)ij\ — > Vj almost surely and in L , 



the limits 



and Vj is nondegeneratc for j < </, Vj+i = 1. Since = 1, we have proved the induction step for k = 1 
and i/j = for Case 1. 

For the remainder of the cases, the proof is done in two steps. We first show L 1 -boundedcdness of 
Z N := C$ k /(N x i(logNp) and then we show the required almost sure and L -convergence by constructing 
an appropriate martingale. 

Step 1 (L 1 bound) : Observe that CV+u = Cni + Z)m=i m r ml, which gives, 

l-l 



E [C n+i,i\J~n] — Cni I 1 



n 



N + l 



N 



+ 1 ^ 



NmXral i 



m—1 



leading to 



E [Cn+i,i] = E[Cni] 1 



n 



N + 1 



1 ' _1 

— E E \ C Nm] 



r-ml 



(3.5) 



Iterating, we have 



l-i N 

CoiUNin) + V r mi V ——E[C nm ] 
L — ' * — ' n+l 



m—1 n— 



n n (n) 



to conclude, using Co; = Cg fc and Cni = C;vL 



.0) 

'JVfc 



i-l JV-l 



njv(r/) 



r«W . _ \ " 1 E[C nm ] 

ok ml ^n + i n„(n) ' 



m—1 n— 



(3.6) 



(3.7) 



Case 2: fc = 1 and za,- > 0. We also have fj-i = Vj — 1 and rj = Aj = Aj_i. Then using (|2.3[) . (|3.4p 
and (13.71). we have 



' ATfc 



i-l JV-l 



c^ + E^E 



(log(n + 2))"J- 



E[C nm ] 



Hn(X 3 ) ~ ufc ' ^.'""^ n+l n^(log(7i + 2))'^- 1 n n (n) 

\j/ m—1 n— v *j\ // \ / 

Thus, again using (|2.3|) . {Zat} becomes L 1 -bounded. 

Case 3: fc > 1. Here we have rj < Xj. Then using (|2.3| . (|3.4|) and (|3 . T[) . we have 



0((IognD- 





'r-0') " 


n 





i-l iV-1 

effl + E ^ E 



(log(n + 2)p E[C 1 an J 



^ n (n + l)n r '-^ ra*'-(log(n + 2))^ IT n (r,) 

m—1 n— 



0(n A ^ ri (lognp) 



Thus, again using (|2.3p . {Zw} becomes L 1 -bounded. 

Step 2 (Convergence) : Now we construct the relevant martingale. Using (|3.5p . it is easy to check that 

l-l JV-l 

M w = ^—7—7 - ,T. ^7'\ (3-8) 



C 

n N (n) ~ ^ \ n + i + r ; ri; 

v ' m—1 n— 



(n) 
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forms a martingale. The martingale difference is given by 

1 



M 



N+l 



M 



N 



n 



N+l 



in) 



i 

E 



Ni. 



N + l 



which leads to, using (|3.4|) and L 1 -boundedness of Zn, 



E[(M N+1 - M N f] 



1 



< 



1 

(iW^)F 
o 



E 



E 



■NmT m i 



N + l 



E m= i Ci\f m r m i 
N+l 



N+l 



(3.9) 



(3.10) 



When k 



1, i/j > and A, 



r; = 0, we can further improve on the order of the squared moment of 
the martingale difference given in (|3.10p . First, observe that I being a leading color and ri = imply that 
r m = for all m < I, which makes each of the colors indexed by m < I a leading color of a block of size 1. 
This implies j — I. Since the diagonal elements corresponding to all these colors are 0, we have v m = m — 1 
for m < I. Since Uj = j — 1 = I — 1 > 0, we have I > 2. Thus, (|3.4|) simplifies to E[C nm } = O ((log 
for m < I. Also, ri being zero, the Z-th term in the sum of (|3.9[) does not contribute. Hence, we have 

'(logiV)^- 1 ) 



\m-\\ 



E[{M. 



N+l 



M 



N 



O 



N 



(3.11) 



Case 2: k = 1 and Vj > 0. Here we have I = ij and n = A_,-. First assume that n = Aj > 0. Then the 
right side of (|3.10p is summable. Hence Mm is an L 2 -bounded martingale, which converges almost surely, 
as well as in L 2 . Since Vj > 0, we have 



(log TV)"; 



■M 



N 



almost surely and in Lr 



Next assume r\ = Xj =0. Then, using (|3TTT|) . we have M N /(\ogNy^ 2 is i 2 -bounded. Hence, we have 
Mjv/(logiV)^ -»■ in L 2 . We shall now show that 



1 



N ■- 



-Mat converges almost surely. 

almost surely as well as in L 2 . With 



(log iV) 1 

Since the L 2 -limit is known to be 0, we shall then have Yjy 
A 7v = l/GogA) 1 ^, we have Yn = Mn&n, which gives 

Y N+1 -Y N = M N+1 (A N+1 - A N ) + A N (M N+1 - M N ). (3.12) 

Thus, it is enough to show that the partial sums of each of the terms on the right side of (|3 . 1 2[) converges 
almost surely. 

Now, Ajy is a deterministic sequence and 

'log(A+ 1) 



A 



AM 



log A 



1 



A(logA)^ +1 ' 



We further know that M^/O-Og N) u ^ 2 is L 2 -bounded and hence i 1 -boundcd. Thus, recalling Vj > 0, we 
have £ , [|A/jv+i(Ajv+i — Ajv)|] is summable and hence the first term on the right side of (|3.12p is almost 
surely absolutely summable. 

Now, since Mjv+i — Mm is a martingale difference, so is the second term on the right side of (|3 . 1 2[) as 
well. By p. lip , we have 

1 (log AT)"*- 1, 



E[A N (M N+1 - M N ) Z ] = O 



(log A) 



2i'> 



N 
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which is summablc, as Vj > 0. Hence the second term on the right side of (|3 . 1 2|) is the difference sequence 
of a martingale which converges almost surely, as well as in L 2 . Thus we obtain that Ijv converges almost 
surely, as well as, in L 2 to even when n = Xj = 0. 
Hence, under the assumption k = 1 and Vj > 0, 



3 

1 



(log Np 

Using p.8p . we then have 



Mm — > almost surely and in L 



lim £M Urn JM^LVVr ■ ^21!^ . VlL Cnm 

n—>cc N x i (log N")"i n^oo N x i(\ogN)^ £^ ^ m ' lj n + 1 + Xj U n (Xj ) n x o (log n) v i - 1 ' 

where the limit is in the almost sure as well as L 2 sense. Since Vj > 0, we have Xj = Xj—i and Vj — 1 = Vj—\- 
Thus, from JO) and JO), we have 



N^QogN)* ~ N^QogN)* Vj ^ m Pm ~ Vj 9 J ~ l ( j 

almost surely, as well as, in L 2 . We obtain the formula of Vj in terms of Vj-i from (|3.13[) . Since, by 
normalization, = 1, we have the induction step for k = 1, Vj > 0. 

Case 3: k > 1. Thus, n < Aj holds and hence Aj > 0. If rj > Aj/2, using ()3.10p . we have Mjy is an 
L 2 -bounded martingale and hence converges almost surely as well as in L 2 . Thus 

M N /{N x i- ri (logNp} -> almost surely and in L 2 . 

The analysis is a bit more elaborate when r ; < Xj/2. If r ; = Aj/2, using lj3TTO]) . il/Ar/(logiV)^ +1 )/ 2 is 
L 2 -bounded. On the other hand, if n < A^/2, again using (|3"3U]) . M N / (N x ^ 2 ~ r ' (log N) u ^ 2 ) is L 2 -bounded. 
Hence, for r; < Aj/2, 

MAr/{^ A ''" n (logiV)^} in L 2 . 

We shall now show that Yjy := Mjv/{iV Aj '~ n (logiV) I/j } converges almost surely (and hence to 0) even 
when n < Xj/2. With A N = l/{7V A ^ ri (logiV)^}, we have Y N = M N A N , which gives 

Y N+1 -Y N = M N+1 (A N+1 - A N ) + A N (M N+1 - M N ). 

As before, it is enough to show that the partial sums of each of the terms on the right side converges almost 
surely, which can be proved in a similar manner, using 



We leave the details for the reader. 
Using (|3.8p . we have 



N \ logN 



A, - n 



fifi+Xj-n (log 



H Cni - lim n Af(n) v- 1 ^ (Jogrip n ri C nm 

n^oo N x i(logNp ~ n™oo N x i(logN) v 3 ^ Tml (n + 1 + n)n r '-^ TL n (ri) n A *(logn)^ ' 

where the limit is in the almost sure as well as L 2 sense. Thus, from (|3.3[) . using the fact that tt^' is the 
left eigenvector of Ry> for the eigenvalue Aj, we have, 

; Wfc ; = ; OT ; ► — — V 7r#r W , V = tt^V almost surely and in L 2 . (3.14) 

N x i(logN)»j N x i(logNp Aj-n^ m mfc J fe J * V 7 

This completes the proof of the induction step and the proof of the Theorem is complete. □ 
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4. Three color urns 
We now specialize to three color urns. The replacement matrix is then 




R = r 22 r 23 . (4.1) 



We assume that the entries are non-negative, each row sum is one and (|2.2[) holds. The latter is equivalent 
to assuming m < 1, 7*22 < 1; and ri 2 > 0, whenever ru = r 22 . 

This three color urn model has already been considered in Flaiolet et al. ( 2006[ ). who further assumed 



that m > 0, ri2 > and r 2 2 > 0. Under these assumptions, they established the weak convergence of 
appropriately scaled C„ and obtained the limit distributions (cf. iFlajolet et al" . 20061 Propositions 25 and 
26). 

In contrast, we have established the almost sure convergence of scaled C n . We restate our result as 
applicable to the three color urn. 



Corollary 4.1. Suppose we have a three color urn model with triangular replacement matrix R given by (|4.1j) 
with non-negative entries and each row sum one. Assume that ru < I, r 22 < 1; and r\ 2 > 0, whenever 
r\\ = r 22 . Then there exists nondegenerate random variables V\, V 2 and V3 such that 

(i) C n3 /n 1. 

(ii) If ru = 0, then C n \ stays unchanged at Cq\. 
Ifrn > 0, then C nl /n ri1 -> Vi. 

(hi) Ifrn > ru, then C n2 /n r22 -> V 2 . 

(iv) Ifr 2 2 = ru and r i2 > 0, then C n2 /(n r22 logn) — > r 12 Vi. 

(v) J/r 2 2 < ru and r 12 > 0, then C n2 /n Tl1 -> ri 2 Fi/(ru - r 22 ). 
J/0 < r 22 < ru and r\ 2 = 0, then C n2 /n r22 — > V3. 

(vi) If r 12 = r22 = 0, then C„2 stoj/s unchanged at Cq2- 

The convergence of all the above random variables is almost sure as well as in L 2 . 

Three color urn m odels with reducible and block triangular balanced replacement matrices were considered 
Bose et al. (120081) . They established almost sure convergence of appropriately scaled individual color 



counts as well as weak/strong limits of linear combinations C n C for suitable vectors C obtained from the 
Jordan decomposition of R. 

Armed with the strong laws obtained from Corollary 14.11 we can now extend the results in iBose et all 



(|2008l ) to the case of three color urn models with triangular replacement matrices. Observe that £1 = (1) 0, 0)' 
and £ 3 = (1, 1, 1)' are always right eigenvectors of R with respect to the eigenvalues ru and r 33 respectively. 
Clearly, C„£ 3 /(n+l) = 1 for all n. Also, since C n £ 1 = C n \, its limiting behavior is given in Corollarv l4.1l fii). 

Now observe that if ru ^ r22, then R has a right eigenvector £ 2 with respect to the eigenvalue r22, given 
by £2 = ( r i2 ; ( r 22 — ru),0)'. If r22 > ru, then, from Corollary 14. II (ii) and (iii), we have 

C n $, 2 /n r22 —> (r 22 — ru)V 2 almost surely as well as in L 2 , 

since the contribution of C n \ is of smaller order. 

If r 2 2 < ru and r 12 = 0, then, observe that C„£ 2 = ( r 22 — r u)C n2 . If we further have r 2 2 > 0, then from 
Corollary 14. II (v). we get 

C n £ 2 /n r22 — * (^22 — ru)V3 almost surely as well as in L 2 . 

But, if we have r 12 = r 2 2 = 0, then C„£ 2 remains constant at Cq£ 2 . 

If = r 22 < ru and r\ 2 > 0, then observe that £ 2 being an eigenvector of R with respect to the eigenvalue 
r 22 = 0, i?£ 2 becomes a null vector. Also, if, for j = 1, 2, 3, the j-th color appears in the n-th draw, C n £ 2 
increases by an amount which is the j-th coordinate of i?£ 2 , namely 0. Thus C„£ 2 remains constant at 
Co£ 2 - 
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The situation becomes interesting when < r 2 2 < rn and ri2 > 0. Note that in this case, we have, from 
Corollarv l4.ll (ii) and (v), that C n £ 2 /n ri1 ~ * almost surely, as well as in L 2 . We summarize the asymptotic 
behavior of C„£ 2 m this case in the following proposition. 

Proposition 4.2. Suppose we have a three color urn model with triangular replacement matrix R given 
by (|4.ip with non-negative entries and each row sum one. Assume that < r^2 < ru and T\% > 0. Let V\ 
be the almost sure limit of C n i/n Tl1 obtained in Corollary \4.1\ (ii). Then the following hold: 

(i) // r 22 < rn/2, then C„| 2 /V^7 ^ N ( , Fl ) . 

(ii) Ifr 2 2=r n /2, then C n £ 2 / yV" logn => N (0, r 12 r| 2 (r 12 + r u - r M )Vi). 

(hi) // r 22 > t'ii/2, i/iew C n £ 2 /n T22 converges almost surely and in L 2 to a nondegenerate random 
variable. 

Note that here Vi is a random variable and the above limits are to be interpreted as variance mixtures of 
normal distributions. 



Proof. The proof is same as that of Theorem 3.1 of iBose et al.l (|2008|) . The limiting variance in (i) above 
will be r 22 Vi7r£ 2 / (ru — 2r 22 ), where £ 2 is a column vector with coordinates which are squares of those of £ 2 
and 7T = (l,ri2/(rii — r 22 ),0) is a left eigenvector of R corresponding to ru. The limiting variance in (ii) 
above will be r 22 Vi7r^ 2 - A simplification in either case gives the result. □ 

However, if 7*12 > and ru = r 22 , then for this repeated eigenvalue, it can be checked that for any a, 
£ 2 = (a, l/ri2, 0)' is a Jordan vector satisfying R£ 2 = £1 + rn£ 2 . Hence, from Corollary 14. II (ii) and (iv), 
we have 

C n £ 2 / \n r ' 22 logn) — > Vi almost surely as well as in L 2 , 
where V\ is the almost sure limit of C n i/n ri1 obtained in Corollarv l4.ll (ii). 
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